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A METHOD OF PRODUCING AUDIBLY DISCERNIBLE SOUNDS 

The present invention relates generally to a method for producing audibly discernible 
sounds, and particularly to a method in which the sounds are representative of complex 
structures. 

In the rq)resentation of conq>lex structures occupying three-dimensional space it has 
been conventional rither to use stylised models of the structures, themselves occupying 
the three-dimensional space, or to represent the structures in two-dimensions with an 
appropriate rq>resentational convention by which the information concerning the third 
dimension is conveyed. 

Each of these rq)resentational techniques has inherent drawbadcs. Three-dimensional 
models, although they can be produced accurately, are not readily transportable nor are 
they mdefinitdy extendable, so that, for ©cample, a highly complex structure may be 
limited to a representation of only a portion under immediate examination. Although 
two-dimoiaonal representations are more readUy portable, and can also be converted 
into a form suitable for display on a screen such as a computer screen, tiie necessity for 
a drawing convention to represent tiie third dimension results in a degree of 
imprecision and uncertainty in the accuracy of the representation. The present 
invention proposes a complete departure from conventional representational techniques 
by proposing to provide an audibly discernible representation of spatial information. 

The present invention finds particular (but not exclusive) application in the 
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representation of naturally-occurring structures such as biolo^cal structures, especially 
proteins. Structure, pattern and form are inherent in naturally-occurring biological 
material, and these features may be drawn upon to provide parameters for audibly 
discernible r^t«sentations. In the representation of spatial information in audible form 
5 the audible information may approximate to, or be conadered as, music. Culture and 
musical tradition has resulted in the evolution of music consisting of references and 
structures often not consciously appreciated by the listener but neverthdess having an 
effect on the physiological perception of the music. Recent developments in digital 
computmg have made available to musicians fiirther means by which musical 
10 con^oation may be devdoped, and it is not unknown for a distal computer lo be used 
as a compoational tool for developing new structures in music. This new type of 
muMC is sometimes called algorithmic, and such muac, developed writh computer 
process rules, may combine tonal and structural relationships which it would be 
difiBcult to calculate by traditional means. 

15 

The audible representation of biolo^cal structures such as proteins may, therefore, 
result in sounds which may be muacal in their form. Proteins are biolopcal macro 
molecules which are the fundamental building blocks in all life forms. Proteins are 
composed of a plurality of sub units, amino acids , whidi are arranged according to the 
2 0 individual amino add properties to form a three dimensional molecule. It is recognised 
that music is defined by the intervals between notes rather than the absolute pitches of 
the notes and, correspondingly, proteins may be considered as bdng defined more by 
thdr overall patterns than by their absolute or primary sequences. Protdns structure^ 
may be considwed to comprise four mains dements or levels of complexity, ^tly a 



primaiy staicture which is the linear order in which the amino add sub units occur. A 
secondary and a tertiary structure determined by the properties of these amino acids 
which give rise to structural features referred to by biologists as loops, turns, alpha 
helices and beta strands or beta she^ depending on tiie spatial anangements of the sub 
units in the linear sequence. Quaternary structures are recognisable as the quaternary 
structure is the broadest structural level concerned with the airaiigeraent of individual 
protein "blocks" which fit together to form tiie final protein molecule. 

At the primaiy level, alpha helices are unifoim coU-like structures in which tiie 
functional groups or R-groups of tiie amino acid project outward fi-om the helbc axis. 
On tiie otiier hand secondary structures known as beta stoands fold back and fortii 
witii individual amino add R-groups projecting from tiie folded chain on alternate 
sides. Different beta strands may be aligned witii one another, adjacent strands forming 
weak bonds which connect tiiem into what are called beta-sheets. Also at tiie 
secondary/tertiary level regions of tiie molecule referred to as "turns" follow a diffensnt 
directional patii and are commonly found connecting two regions of an alpha helfac 
beta strands. These are structures spanning both the secondary and tertiary level 
tiiat tiie folding patterns of tiie secondary stiuctur«s are combined to produce tiie 
overaU tertiary structure of a proteb. Information concerning the relationship of tiiese 
features is usually considered at a visual level and represented visually. The present 
invention provides an ahemative means of representation allowii^ other senses to be 
involved. 



or 
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According to one aspect of tiie present invention, tiierefore. a method of produdrig 
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audibly discernible representation of a three dimenaonal structure conq)rises the steps 
of: 

generating numerical information concenuqg the spatial poation of identifiable 
components of the structure firora analysis of the structure, 
5 converting the numerical information into a derived *gital signal by fornung 

moving averages of the numerical information, 

subjecting the doived digital agnal to a converaon from the three-dimenaonal 
value to produce a signal having a scalar value representing at least one of the 
properties of a au^bly discenuble sound, and 
L 0 generating a sound having that or those properties. 

At a fundamental level it may be considered that each positional coordinate 
representing the presence of a feature or structural dement of the structure may be 
allocated a unique discernible sound. It is of course important that tiie same sound is 
15 repeatably produced by the same feature, but it is not essential tiiat only one feature 
produce that sound.appUed to the representation of a naturally occurring structure, 
such as a protein the analysis may be performed by x-ray ciystaUography to determine 
tiie relative locations of the amino acids o f which the protein is composed. In its 
appBcation to other structures, however, different analysis techniques may be used on 
20 order to generate the raw positional data and. of course, the coordinate information 
may represent the positions of other significant elements in the structure. In an 
engineering structure, for example, the positional coordinates may represent the nodes 
in a load-bearing assembly and/or tiie stresses appUed to elements of a structure during 
operation or when performing its fimction. For example, tiie stresses exerted on an 
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element of a building may be represented by pitch , variation of which represents 
increases in the stress so that dynamic variation of the stress pattern can be represented 
audibly which enables a plurality of different signals to be perceived simultaneously 
even in a structure in ^^ch, with a tradidonal visual representation, certain 
5 components may be masked or covered by others and therefore not visible. 

In the representation of structures such as proteins the resultant data of the x-ray 
crystallography ana^fsis may comprise a set of poational coordinates representing the 
relative portions of at least some of the atoms of the amino acids of the protein. In 
1 0 particular the positional coordinate data may represent the tiiree dimensional positions 

in space, with respect to a gnrea frame of reference, of the CA caiijon atoms of the ^ 
amino a^ of the protdn. 

Although individual unique sounds may be generated these sounds may not necessarily 
15 be represented, by individual musical notes, but could be other detectable sounds such 
. as chords or discordant sounds. 



In tiie performance of tiie metiiod of the invention the said moving averages comprise 
at least a first moving average of the value of the positional coordinate data scanned 
ovor succesave groups of carfwn atoms to provide an approxirarte representation of 
the secondary structiire of the amino acids in the protein. 




Likewise, a second moving average of the values of the first moving average may be 
taken over a range of vahies thereof greater Uian the range used to form the first 



moving average. This second moving average provides a further degree of 
"smoothing" to act effectively to filter out the smaller scale variations, without 
completely excluding larger scale variations. 

Further sequences of digital signals may be derived from the said first and second 
moving averages, for example by determining the differences between the first moving 
average and the poational coorcfinate data, whereby to provide a distal data signal m 
which larger scale variations are not present and smaller scale variations are amplified. 

The second further sequences of digital signals may be derived firom the first and 
second moving averages by determining the differences between the first and second 
mowig averages whereby, in cflFect, to act as a mid-frequency filter on the dat a. 

The method may include derivdng a tWrd fiirther sequence of digital signals by 
nomalising the second moving average values about a selected oripn to represent the 
large scale features of the positional coordinate data stream. This, effectively, acts as 
a low frequency filter to produce signal dependent on the large scale features. 

The said first, second and third fiirther sequences of digital rignals may each be 
multiplied by a respective weighting factor and sunmied to produce a single sequence 
of averaged and processed three dimcnaonal coordinate values whidi are then mapped 
onto a sequence of one-dimensional values. This may be acWeved via a three- 
dimensional wave form generated by spectral synthesis, using a fourier syntiiesis 
techraque. or by other techniques wMch provide a repeatable mapping of a three- 
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dimenaonal point onto a one-dimendonal point which can be interpreted as a musical ^ ''^^^^^ ^ v 
parameter. A simple exmple might be to sum together the three coortUnate values to 
get a angle one-dimensional value. 

5 The one-dimensional value may be pitch or volume and other means may be provided 
for varying the attack and decay of the sound in order to generate muacal notes. 



The present invention also comprehends a method of produdng an audibly discernible 
rq)resentation of a thiee-dimensonal structure in which the identification of the details 
1 0 of secondary structures in the positional coordinate data is obtained by means of a 
filter. 

In another aspect of the invention a method of producing audibly recognisable sounds 
representiiig respective amino acids in a protein structure comprises the steps of: 

1 5 subjecting the protein structure to an x-ray crystallography analysis to produce a series 
of raw data signals representing the three-dimensional positional coordinates of the CA 
carbon atoms of the anano adds of which the protein is composed; filtering the said 
raw data signals to generate a plurality of derived moving averages thereof whereby 
to filter out large and small scale variations respectively; generating fi^om the derived 

20 moving averages a composite signal including weighted moving averages as 
components thereof; and generating from the said composite signal an audible signal 
in which each amino acid is rq)resentcd by an identifiable-musical note 



present invention may be embodied in apparatus including visual display means by 
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which the raw data positional coordinate signals may be displayed graphically in 
synchronism with the audible output signals such that visual and aural correspondence 
is discernible. 

5 The present invention also comprehends apparatus for producing an audibly 
discernible representation of a three-dimensional structure, comprising: 

means for analysing numerical information to generate representations of the 
position of identifiable components thereof; 

means for forming moving averages of the said numerical information, 
10 - - means for converting the moving averages of the numerical information into 
scalar values, and 

means for allocating pitch or volume values to ±e said scalar values to 
generate audible sounds related to the structure. 

15 Various examples of the invention wU now be more particularly described. 

Example 1: for the generation of muacal notes representing tiie individual animajd^ 
of a protein structure, each x, y and z positional coordinate of the CA carbon atom 
from each amino acid in an original protein sequence SO derived from x-ray 
20 crystallography analysis is processed twice, once to extract a first moving average SI, 
calculated by averaging tiie values of tiie sequence SO over a range of five amino acids, 
and tfien a second time to extract a second moving average S2 calculated by averaging 
the values of tiie moving average SI over a range of twenty five amino acids. The first 
moving average represents the secondaiy structure of the protein and the second 
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moving average represent the tertiary structure. 

From these three digital data streams S 50, 51, 52 may be derived three further 
sequences as follows: 

5 1 SO-1 is calculated by subtracting the first moving average S 1 from the original 
three dimensional data SO. This has the eflFect of emphasising the small twists and turns 
of the protein and of masking the larger scale curves over the protein structure as a 
whole. This in eflFect acts as a high fi^equency fUter on the three-dimensional structure 
of the protein and highUghts the spiral shape of the alpha helices. By subtracting the 

10 first moving average from the original data all the short-term fluctuations are 
maintained within the structure of the alpha heUces without interference from larger 
scale changes. By mapping this to pftch variation an accurate sonic representation of 
the alpha helices is obtained. This mapping results in the generation of sequences of Wo»-^*"/ 
arpeggios wfa ffl the alpha helices are traversed, and the same or a sHghtiy varying note 

15 is heard when the beta sheets arc traversed. This latter results from the fact that a beta 
sheet contains few small-scale changes. 

Sl-2 is created by subtracting the second moving average from the first moving 
average. This has the effect of amplifying the medium sized turns of the protein whilst 
2 0 attenuating the higher frequency alpha hdbc turns and the lower frequency large scale 
curves. This process acts as a medmm frequency filter on the three-dimensional 
structure. 



Finally, S2-3 is derived by calculating the mean position of all the amino acids in the 
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raw data SO to create a second moving average by subtracting this mean from each 
value of a coordinate for an amino acid in the moving average S2. The resulting 
sequence S2-3 is essentially identical to the sequence S2 but is normalised about a 
central zero origin point. This sequence represents the larger scale curves of the 
5 original threwlimaisional proton structure, effectively acting as a low frequency filter. 

Weighting factors are then applied to each sequence and the weighted sequences 
summed to give a final sequence ST = a (SO-1) + b(Sl-2) + c (S2-3). The magnitude 
of the weighting fector a determines the proportion of the high frequency component 
10 of the protein in the final sequence ST whilst b and c d^ermine the mid frequency and 
low frequency component. 

The sequence ST is than mapped onto musical parameters such as pitch via a three- 
dimenaonal wavrfbrm generated by three-dimensional spectral synthesis, tfius creating 

15 sequences of notes which express visual features in rauacal form. The waveform maps 
a tfuee-dimenaonal coordinate value onto a one-dimensional value, that is the value 
of that point in the waveform. The three dimensional input values are a sequence of 
coordinate values from ST and the output is a sequence of one-dimensional values 
which are interpreted as notes in musical scales or dynamic levels (volume). This 

20 mapping may be adiieved as follows. First a random number (ranging from 5 to 20 or 
more) of vectors are provided which reside in a 2-dimensional frequenqr-space (the 
frequen(7-space is the spectral analog to the final 2 dimenaonal landscape). Each 
vector has a randomly deternuned poation in this firequency-space and has a randomly 
determined phase and magnitude associated with it (represented by a complex number). 
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For mathematical reasons, there must also exist for each vector a 'mirror' vector with 
the same vector location but having a comploc number associated with it that is a 
complex conjugate of the original vector's complex number. Therefore there must 
always be an even number of these vectors. 



Once these vectors with their associated complex numbers have been generated it is 
a simple process of fourier synthesis so that given a 2-dimensional coordinate in 
cartesian space, one can sum the contributions of each vector (at the cartewan 
coordmate) to end up witJ< a scalar (1-dimensionaO value which can be int^reted as 
a height value. Details are given by D. Saupe. Since the resulting "landscape" is 
constmcted from a combination of waves, for a small list of vectors it has the property 
that two points dose to each otho- in 2-dimensions have similar resulting height values 
(i.e. mathematicaUy speaking, the landscape is continuously differentiable everywhere. 

This process is extended to 3-dimensions by generating a list of 3-dimensional vectors 
in frequency -space. When given a point in 3-dimensional cartesian space, these 
vectors can be summed using complex arithmetic to provide a 1-dimensional scalar 
value. This aUows a 3-dimensional coordinate (i.e. 3-dimensionaI position of a CA 
atom after the moving average process) to be turned into a 1-dimensional scalar value. 
In an analogous way to the 2-dimensional syntiiesis. two points dose to each other in 
3-dimensionaI cartesian-space will have dose 1-dimensional results from the mapping. 
This means that dose 3-dimensional positions will have dose (audibly related) pitch, 
amplitude or other such musical value. 
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Whilst this invention may make use of a fourier synthesis technique, fourier synthesis 
by such is not new, and this invention includes the use of any other method of mappif^g 
a 3-dimensional point, for example derived from filters or moving averages of x-ray 
ciystallography data to a 1 -dimensional point which can be interpreted in a musical 
feshion. A simple example might be simply to sum together the x, y, and z values of 
the 3-dimensional coordinate to get a single l-<iimenaonal value. Another alternative 
in the spedfic case of proteins may be to use the coordinates of the second moving 
average as an "axis" and to calculate "angular" offsets of the original data from that 
axis. As the alpha hdix twsts around a sequence of angles averapng around may 
then be derived. 

This output is then written to a MIDI text file for conversion into music or a layer in 
a musical arrangement using known MIDI music software to produce complex multi 
timbral musical pieces containing melodies reflectirg the large-scale tertiaiy stmctures 
or small repetitive arpeggios expr essing the structural nature of the alpha helices. 

Example 2 : for the production of a musical representation of a protein. This follows 
the same basic method as described in relation to example 1 above, with the addition 
of tempo, rhythm and key changes derived from the x-ray crystallography coordinate 
data. 



In this example positions in the ori^nal data sequence are determined where the 
musical parameter changes are to take place corresponding to visual transmission 
points in the secondary structure of the protein, for ©cample where an alpha helix, a 
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beta sheet, a loop or a turn b^ins or ends. 



The secondary slmcture details are identified using a filter. This filter outputs 
secondary structure features fi-om an input compriang the three-dimensional data. 
Two filter tediniques may be used in the identification of the secondary structures, 
namely: 

FUter technique 1 . The three dimensional distance of each CA caibon atom is taken 
firom the mean position of the CA carbon atoms of a particular section of the protein. 
The filter moves a window containing data covering approximately 10 CA carbon 
atoms for different annno acids alorig a section of the crystallography data looking at 
the distance of eadi CA carbon atom from the mean value of all the carbon atoms in 
the current window. From these distances it is possible to determine the Hkelihood of 
the current window containing data fi-om an alpha helix or a beta sheet. The 
termination points of these features roay thus be identified. 

Filter technique 2. In this technique matched filters are used with parameters tuned to 
those finind in protein alpha helices and beta strands and the like. For example; alpha 
helices will have an approximate pitch of 4.6 arigstrom units, beta sheets wiU have an 
approximate pitch of 13.5 angstrom units. 

Example 3. This example may be embodied in a model giving participants the 
opportunity to create their own pieces of music ft^om a range of onscreen three 
dimensional proteins. The three dimensional x-ray crystallography x. y. z coordinate 
data is used as the basis fi)r an animated display of the progress of the generated music 
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along the physical structure of the proteins as displayed graphically on a computer 
screen. By choosing from a selection of moving average operations the user can see 
how the chosen proteins are converted into musical sounds. The weightings a, b, c of 
example 1 may be made available to the user for selection, and their combination by 
the computer then results in a sequence of notes. 

Each note, corrcsponcting to a specific amino add in the display, is then sounded with 
the amino acid on the display, with the visual representation of the protein bring 
highlighted simultaneously whereby to demonstrate and emphasise the correspondence 
between the musical notes and the protein sequences. 

Exam ple 4: a display booth or «hibition kiosk may be equipped with an interactive 
touch screen computer system containing both the audio and visual components 
described in relation to examples 1 and 3. The screen may display graphics generated 
using a grapWcs processor depicting a traverse through the biolo^cal material of a 
plant, animal, insect, fimgal, bacteria, yeast or human "landscape". The protein 
molecules are used to derive musical sounds identifymg the proteins. This may also 
have an educational value in. enabling aural recognition of proteins. 

Example 5. Another educational application may be developed as a three dimensional 
tactUe model of a protein containing a plurality of switches connected to a computer 
system whereby the display of an audio visual information device may be influenced. 
On touching a particular amino acid (that is operating the associated switch) the amino 
acid on the display screen would be highlighted and the corres ponding note, chord or 
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Other musical sound representing this amino acid generated for the user to hear. 



The present invention thus expands and crosses the boundaries between science and 
art, enabling new approaches to understanding biolo^cal structure to be achieved as 
well as the generation of music for educational or purdy entertiunment purposes. Use 
of this invention in prot«n homology modelling, where fast and easily recognisable 
differences in protdns of similar structure are requited, may be devdoped as there is 
a currently unfulfilled dwnand for such a tool in this widely used researdi technique. 



Protein-derived music may be of therapeutic interest in the treatment of conditions 
currenUy treated using music therapy. It is believed that such specialised music may 
offer a focused and precise appUcation which optimises and hence is more cost 
effecUve than, known music therapies utUising music derived from other sources. 
Protem-derived music may be used to strengthen mind-body connections. Likewise, 
protein-derived music may be used for studying and modelling protein sequence data, 
complementing existiitg techniques which have wide application in drug design. Since 
alpha helices, beta strands and turns each have characteristic combinations of 
hydrophobic and hydrophiUc amino acids, different structural categories of proteins, 
which combine these secondary elements in different ways, also have different musical 
characteristics. The sounds generated therefrom may therefore be used effectively in 
the discrimination and dononstration of different protein types. 

Protein music may also be used in sequence alignment and structural homology 
determination as structural homology may be heard when it might not easily be 
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perceived visually. 
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CLAIMS 

1 . A method of producing an audibly discernible representation of a three 
dimensional structure, comprising the steps of generating numerical information 
concerning the spatial positions of identifiable components of the structure from 
analysis of the structure, converting the numerical information into a derived digital 
signal by forming moving averages of the numerical information, subjecting the 
derived digital signals to conversion from a three dimensional value to produce a 
signal having a scalar vahie representing at least one of the properties of an audibly 
discermble sound, and generating a sound having that or those properties. 

2. A method as claimed in claim 1, in which the structure is a protein and the 
analyas of the structure is performed by x-ray crystallography to determine the 
relative locations of the amino acids of which the protein is composed. 

3. A method as claimed in claim 2, in which the results of the x-ray 
crystallography analysis comprises a set of position coordinates representing the 
relative positions of at least some of the atoms of the amino acids of the protein. 

4. A metiiod as cl^umed in claim 3, in which the position coordinate data 
represents tiie tiiree dimensional position in space, with respect to a given frame of 
reference, of a carbon atom of the amino acids of the protein. 



18 

5. A method as claimed in any preceding claims, in which the said moving 
averages comprise at least a first moving average of the value of positional 
coordinate data scanned over successive groups of carbon atoms to pro^de an 
approximate representation of the secondary structure of the amino acids of the 
protein. 

6. A method as clsumed in claim S, in v^ch a second moving average of values 
of the first moving average is taken over a range of values thereof greater than the 
range used to form the first moving average. 

7. A method as claimed in claim 6, in which there is formed a first further 
sequence of digital signals derived firom said first and second mo^dng averages by 
determining the difference between the first moving average and the positional 
coordinate data, whereby to provide a distal data signal in which larger scale 
variations are not present and sanallo- scale variations are amplified. 

8. A method as dmmed in claim 6 and claim 7, in which a second fiuther 
sequence of distal signals are derived fi^om the first and second moving averages by 
determining the diflFerence between the first and second moving averages whereby 
in effect to act as a mid-frequency filter on the data. 

9. A method as claimed in any of the clsdms 6 to 8, in which a third further 
sequence of digital signals is derived by normalising the second moving average 
values about a selected ori^n to represent the large scale features of the positional 
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coordinate data stream, acting effectively as a low frequency filter. 



10. A method as claimed in Claim 9, in which the said first, second and third 
further sequmces of digital signals are each multiplied by a respective weighting 
5 factor (a, b. c) and summarised to produce a single sequence (ST) averaged and 
processed three-dimensional coordinate values which are then mapped onto a 
sequaice of one-dimensional vahies w a three-dimensional waveform generated by 
spectral synthesis. 

10 11. A method as claimed in Claim 1 0, in which the one-dimensional value is 
pitch. 



A me thod as claimed in Claim 1 1, in which th ^^pitchs^g^ ^ a 
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musical chord or/a single note. 



13. A method as claimed in Claim 10, in which the one-dimensional vahie is 
volrnne. 

14. A method as claimed in any preceding claim, in which the identification of 
20 the details of secondary structures in the posiUonal coordinate data is obtained by 

means of a filter. 

1 5. A method of producing audibly recognisable sounds representing respective 
amino adds in a protein structure, comprising the steps of: subjecUng the protein 
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stniclure to an x-ray crystallography analysis to produce a series of raw data signals 
rq)resenting the three-dimensional positional coordinates of the CA carbon atoms 
of the amino adds of wKch the protein is composed; filtering the said raw data 
signals to generate a plurality of derived moving averages thereof whereby to filter 
out large and small scale variations respectively; generating firom the derived 
moving averages a composite signal including weighted moving averages as 
components thereof, and generating firom the said composite signal an audible rignal 
in which each amino acid is represented by an identifiable musical note. 

16. A method as claimed in Cbim 15, in which the raw data poational 
coorcfinate signals are also displayed graphically on a display screen in 
sychronisation with the audible output signals such that visual and aural 
correspondence is discernible. 

1 7. Apparatus for producing an auctibly discernible representation of a three- 
dimensional structure, comprising: 

means for analysing numerical information to generate representations of the 
position of identifiable components thereof; 
means for fonning mowig averages of the ssud numerical information, 
means for converting the moving averages of the numerical information into 
scalar values^ and 

means for allocating pitch or volume values to the swd scalar values to 
generate audible sounds rdated to the structure. 
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1 8. Apparatus as claimed in Claim 1 7, in which there are fiirther provided means 
for displaying a two-dimensional visual representation of a three-dimen»onal 
stiucture, an interface with a user to allow selections of identifiable components of 
the structure to be made, and means for visually correlating the audible sounds 

5 produced by the apparatus with the displayed components. 

19. Apparatus as daimed in Claim 18. fiirther comprising means for identifying 
a plurality of components of a structure in sequence and generating a sequence of 
sounds in correspondence therewith. 

0 

20. Apparatus as claimed in Claim 1 7, fiirther including a three-dimensional 
model of the structure, at least some of the said identifiable components thereof 
having associated switching means operable by a user in making selections of the 
sounds to be genoated by the apparatus. 
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